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QUESTIONS ASKED BY THIS STUDY 



: ... Can high school pupils apply transformational rules of o generative 

[ grammar in their writing? 

... Can high school pupils increase their repertoire of grammatical 
structures by a study of generative grammar? 

... Will the proportion of well-formed sentences increase in pupil 
writing in ninth and tenth grades? 

... What kinds of transformational errors will occur in pupil writing? 
Will they increase or diminish over the two years? 
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Among the questions v hich teachers of English most frequently 
ask are those which revolve about the teaching of grammar. Why 
teach grammar? Which grammar? Will teaching of grammar result 
in improved writing? By what criteria can such improvement in writ- 
ing be measured? 

If these questions had been asked a decade and a half ago, the 
answers would have been that gr«.;inmar should be taught to improve 
writing (among other things); that the grammar to be taught was a 
brand of “functional grammar” which was traditional grammar sliced 
another way; that there seemed to be an inconclusive relationship— or 
perhaps, a lack of relationship-between the grammar tau^t and the 
Supposed improvement in writing; that the criteria for assessing im- 
proved writing abilities were difficult to specify and more difficult 
to apply. 

Within the last fifteen years, however, the profession has wit- 
nessed the rapid development of structural grammar and, more re- 
cently, transformational grammar. To be sure, the developments in 
these two grammars had their roots in much earlier scholarly studies; 
only within the last ten years, however, has either of the two systems 
had any wide currency. 

With these new developments in the study of the structures of 
language has come the need to raise the same old questions. For it is 
the proper province of research to l»ring new evidence to bear on old 
questions or to ask the old questions in more searching ways. When 
the whole substance of a field such as grammar is as drastically al- 
tered as it has been of late, it is time to pose the old questions 
again. 

Bateman and Zidonis outline in this study the most critical of 
all questions which most English teachers ask of transformational 
grammar — can students apply the transformational rules of a genera- 
tive grammar in their writing? Will the students taught such trans- 
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formatioiial rules increase in ability to use a variety of sentence 
structures? 



In seeking the answers to these questions, the investigators have 
steered clear of what they consider extraneous matters— class size, use 
of lay readers, frequency of writing, etc., and instead concentrate on 
what they suggest is the heart of successful composition teaching: 
the need for Ae composition teacher to have something to teach— to 
have something of value in the lessons taught in the composition 
classroom. 

The answers which the authors suggest for the questions about 
grammar teaching are outside the tradition of much educational re- 
search. That is, the authors did find that there were differences be- 
tween the experimental and control groups. The students in the ex- 
perimental group did increase the proportion of well-formed sen- 
tences they wrote; they did write increasingly more complex sentences, 
and they did so without sacrificing grammaticality. 

Bateman and Zidonis have performed a valuable service in this 
research. If other studies can be replicated with larger groups in dif-^ 
ferent settings with similar results, the door will be open to much 
more effective use of transformational grammar. In any event, Bate- 
man and Zidonis have supplied some important insists into what 
the teacher of composition can teadi and how this teaching will make 
a difference in the writing abilities of students. 



Stanley B. Kegler 
University of Minnesota 
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FOREWORD 



According to the theories of transformational generative gram- 
mar,* a careful description of the kernel sentences in English pro- 
vides all the structures one needs in order to account for the forma- 
tion of the complex structures. The phrase structure component 
(kernel grammar)^ though, must be developed in terms of the re- 
lationships that seem to hold between the simple and the complex 
structures. We hoped that the ideal kernel grammar would provide 
the simplest base upon which to construct the other components of 
the grammar in the simplest way. It was our intention to ex- 
plore the rules of the kernel grammar in such a way that it 
would be possible to examine the transformational component of 
the grammar informally. The reason for treating the kernel grammar 
formally and the transformational rules informally is suggested by 
the somewhat specialized motivation of this study to provide an ex- 
plication of a generative grammar that could be adapted to a study 
of stylistics in the junior high or high school English class. It is not our 
aim to make generative grammarians of the students, which would 
entail their writing generative grammars, but rather to help them be- 
come stylists who have expanded their capability of generating varied 
and well-formed sentences of the language. The requirement of learn- 
ing how to reconstruct the transformational history of a com- 
plex sentence, which the student must learn to do in order to de- 
scribe stylistic characteristics and well-formedness, is somewhat alien 
to a generative grammar, which generates sentences but does not 
analyze them. Consequently, one must understand how the grammar 
operates well enough to be able to reconstruct the steps through 
which a sentence has passed in its formation. Fairly extensive class- 
room exploration indicates that kernel grammar can be taught rather 
easily in a formal, explicit way; only in this formal way can the 
significant characteristics of the theory underlying the grammar be 



**Those interested in the sources of generative granunar might examine Noam 
Chomsky’s Syntactic Structures and his ‘TA. Transformational Approach to Syntax” 
in Third Texas Conference on Problems of Linguistic Analysis in English; Robert 
B. Lees’ Grammar of English Nominalizations; and Charles Fillmore’s Reports 
#1, 3, and 7 in Project on Linguistic Analysis, The Ohio State University Research 
Foimdation. 
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adequately explored. Furthermore, an explicit account of tiie keorneil 
sentences introduces the student to many of the transformational 
rules since the dose relationship between the simple and tibe com- 
plex provides the basis for cte fi n i n g the terms of dm grammar. When 
studrats can dearly distinguish between kernel and non-kernel 
sentences, the reconstruction of complex sentences becomes a simple 
matter. 

The substantive materials tiiat made up the ejqperimental treat* 
meat are not reprinted here. Teachers interested in examining die 
kind of phrase structure and transformational components used by 
the investigators are referred to the final report of Cocperative 
Research Project #1746 (available frmn die Cooperative Research 
Division of the United States Office of Education), where a sketch 
of the materials appears. In the li^t of recent thecomtlcal discuisiooi 
in linguistics, die reader is reminded that grammatical materials 
developed for experimental study in hi{di schools today might assume 
a radically difl^ment fonn-*even in die transformational-geinerative 
tradition. 

D.R.B. 

F.J.Z. 
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1. INTRODUaiON 



StatanMnt of Problom 

Every composition teadier deals directly with the structure of 
EngUsk Whether he relegates the role of language to a mere com- 
mimioitive fui^ction where it becmnes a vehicle or a container into 
whldb the substance dF coatent or ideas is poured or whethear he be- 
lieves that language can shape ideas as well as convey them, he must 
nevertheless have some means whereby he can talk about language 
witib his pupils. 

The “corrective grammar^ of the typical high school language 
arts series, the earlier “functional grammar^ whidi sou^t to present 
those bits of grammar that would solve usage problems, the “formal 
grammar’* of the Lindley Murray and Bishop Lowth variety— all these 
have been tried extensively in American schools, with no discernible 
success. It now seems abundantly dear that these fragmented, pre- 
sdentific grammars are only indirectly related to the structure of 
English. The classroom teacher of composition was unjustifiably opti- 
mistic in assuming that by studying the terms and concepts of these 
grammars his pupils would develop insight into the complex workings 
of English structures. 

Thus even the teacher tiained to use all the grammatical equip- 
ment available to him would not be able to help his pupils write bet- 
ter smitences. Good, acceptable, well-formed sentences are by defini- 
tion grammatical sentences. The pseudo-grammars alluded to above 
do not account for the ways in which sentences are produced; 
in fact, they can off^ no grammatical explanation for the process of 
sentence formation because they are dassificatory schemes that deal 
only with already produced sentences. Structural grammar like- 
wise shares this dassificatory impediment. Though these various 
schemes do provide some sort of basic terminology by which teadier 
and pupils can discuss their writing, they are not held together by any 
linguistic theory that would provide some fuller understanding of the 
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way language actually v/orks. Moreover, they ofiFer no ammatical 
bads for rejecting as a sentence a group of words like The tree is fc- 
markably intelligent, A grammar should be fully able to account 
for the native speaker’s ability to produce novel sentences in infinite 
variety. Grammars that fail to do so, or fail even to strive to do so, 
must be of dubious value for the dassroom teacher of composition. 

With the advmit of generative grammar, which is in essence a 
representation erf the psyc^logical process of producing sentences, a 
logi(^ approach to the study of composition has become available. It 
is the goal of a generative grammar to specify the well-formed and 
only the well-formed gmmmatical sentences of English. The compo- 
sitimi tocher has always strived to get his pupils to write better sen- 
tences, but he has had no procedure whatsoever for explaining to them 
just what the concept sentence contains. A pupil who has only a vague 
notion of sentencehood is doubtless at a disadvantage in evaluating 
the quality of the sentences he has produced or in understanding the 
constructive criticisms of them offered by his teacher. Conscious con- 
trol of well-formed sentences seems fundamental to the act of writ- 
ing, but what is not understood can hardly be controlledL Pupils must 
be taught a system that accounts for well-formed sentences before they 
can be expected to produce more of such sentences themselves. It 
is the function of a complete grammatical system to define the concept 
of sentencehood; consequently all efforts to deal with punctuation, 
sentence fragments, and run-on sentences without recourse to an ad- 
equate grammar must fail. Fragments of grammars— functional gram- 
mar, for example— applied to specific problems of composition eti- 
quette as ad hoc solutions simply reveal a misunderstanding of the 
role grammar might play in language study. Such excerpted bits of 
grammatical lore tend to be modernized forms of the discredited 
eighteenth century grammarian’s authoritarian pronouncements: avoid 
splitting the infinitive, the subject of the gerund must be in the 
possessive case, do not end a sentence with a preposition. These pro- 
nouncements are based not on a theory of language so much as on 
the pontificator’s understanding of the Graeco-Roman grammatical 
tradition. Their relevance for the English language is at least question- 
able; their usefulness in classroom study, highly suspect. 

Granted that many purported grammars of English are inadequate 
and unscientific: Would the study of an adequate grammar of English 
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prove wortibwhile in the secondary school? Is the extant research con- 
clusive in its failure to establish a correlation between the study of 
grammar and the improvement of pupil writing? The first question 
can be answered only empirically; the latter can rather justi- 
fiably be answered in the negative; Meckel (24),* surveying the re- 
search done on grammar and compositional problems, concludes that 
“much of the earlier research on teaching grammar must be regarded 
as no longer of great significance outside the period in educational 
history which it represents.” Of greater importance for the present is 
his statement that “researdi does not justify the conclusion that gram- 
mar should not be tau^t systemically.” Lumsdaine (23) explains why 
much of this now discredited research appeared to be definitive in its 
findings: 

failure to disprove the null hypothesis leaves the experimenter 
... no defensible position except that of suspended judgment 
.... The temptation is great to translate the only defensible 
statement of findings—namely, that the results merely fail to show 
evidence that there was a significant difiierence— into some more 
equivocal and more palatable form, e.g., that “no significant 
difference was found to exist” ... or simply that the two treat- 
ments did not differ significantly” (with that last word often de- 
leted in the final summary. . .). 

The present study seeks to measure the effect that the teaching 
of a generative grammar has upon the writing of ninth and tenth 
graders. The specific questions guiding the study are these: 

1. Can high school pupils learn to apply the transformational 
rules of a generative grammar in their writing? 

2. Can their repertoire of grammatical structures be increased by 
a study of generative grammar? 

3. To what extent will the proportion of well-formed sentences 
increase in pupil writing over the two-year period? 

4. What kinds of transformational errors will occur in pupil writ- 
ing, and to what extent will such errors increase or diminish 
over the two-year period? 



^Numbers in parentheses refer to numbered items in the bibliography on pages 
15 - 17 . 
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Itolated lUsMrch 

Current research in composition seems to have provided little 
of substance on which to build a sound program. Braddock (2), for 
example, in his awnprehenslve survey of the available research into 
written composition, concludes that today’s research is “laced with 
dreams, prejudices, and makeshift operations.” Much of the presently 
available research must be discounted. Meckel (24, p. 967) points 
out that there is now a substantial body of linguistic research and con- 
sequent insights into the nature of language in general and English in 
particular that “have caused many of the studies on the teaching^ of 
composition to lose the significance attributed to them in the past. 

This substantial body of linguistic research may be subdivided into 
two kinds of systematic grammars: analytic and synthetic. Analytic 
gramman: are presdentific in that they are dassificatory and deal ex- 
clusively with limited samples of the language. Anal)^c grammars, 
according to Chomsky (3), have for their highest goal observaiional 
adequacy— B, complete and error-free presentation of the data. Syn- 
thetic grammars, on the other hand, strive for the goal of descriptive 
adequacy when they account explicitly for the linguistic system 
underlying the data; they attain the highest goal, explanatory ade~ 
quacy, to the extent that they are able to relate this linguistic system 
to a general theory of language. In the order of highest to lowest, 
linguists r?>nk these goals as follows: 1) explanatory adequacy, 2) de- 
scriptive adequacy, and 3) observational adequacy. 

In discussing procedures for evaluating grammars, Bach (1) dem- 
onstrates that the taxonomic and data collecting activities of tradi- 
tional and structural grammars fail to meet the test of adequacy. In 
a review of Chomsky (5), Lees (21) deals extensively vnth the topic 
of grammatical adequacy. He concludes that the theoretical character 
of generative grammar and its consequent explanatory and predictive 
power promise to lead to new psychological insights into the natme 
of learning as well as more extensive understanding of the native 
speaker’s capacity to produce an infinite number of the sentences of 
his language. Johnson (13-17) and’ Jenkins (11-12), in fact, are prowd- 
ing empirical evidence of the psychological reality of generative 
grammar theory. The hypothesis that the logical structure of a genera- 
tive grammar is analogous to the psychological structure of the process 
of sentence production is becoming both specTilatively and empirically 
compelling. Katz (18) further expounds tlie psychological reality of 
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generative grammar theory, Hjelmslev (9) reasons, “A priori it would 
seem to be a generally valid diesis that for every process there is a 
corresp<mding system by which the process can be aindyzed and 
described by means of a limited number of premises.’* As a model <rf 
the process of sentence formation, generative grammar should provide 
the most fruitful framework from which to investigate and modify the 
composing process. 

Chomsky (5), Lees (20, 21), and Fillmore (6-8) have already 
made significant starts in Ae writing of a generative grammar of Eng- 
lish. Though by no means to be considered complete grammars, 
these writings present a logical starting point for the study of language 
and composition. A pedagogical grammar, derivative from those four 
segments of grammars, was developed so that hi^ school pupils in 
the present experiment could study the process of sentence formation. 
A set of forty-six r^iles has been used as the framework for describing 
the transformational history of the sentences that have been analyzed. 
This descriptive tool is an objective, largely mechanical device for 
identifying the grammatical components of each sentence produced. 
An analytical device of this sort could provide a scale of expected 
language growth for pupils at different grade levels. Such a scale 
would extend die earlier attempts of LaBrant (19) and Watts (26), 
who sought to provide a developmental scale of language growth 
within a pretraditional grammatical framework, and the later studies 
of Strickland (25) and Loban (22), who described the complexity of 
speech and writing within a structural grammatical framework. Hunt 
(10), though using a transformational description of sentence struc- 
ture, does not distinguish between well-formed and malformed sen- 
tences; his findings consequently do not seem useful for die develop- 
ment of a scale that would chart expected sentence formation behavior 
at die different grade levels. 

Much of the research which has investigated die relationship be- 
tween a knowledge of grammar and compositional skill has construed 
grammar in a popular, prescientific sense. Scientifically oriented edu- 
cators can hardly be surprised that die experimental classes exposed 
to the study of a prescientific— hence, inconsistent— English grammar 
did not produce significandy better results than control classes that 
did not study such a grammar. The only lesson to be derived from 
such comparisons seems to be that even the diligent study of an in- 
consistent body of materials is no better than the total ahan dnTinnftnt 
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of such study. What students are expected to learn and to apply is of 
utmost importance; yet this part of most experimental programs tends 
to be slighted— final reports of experiments seldom condescend to dis- 
cuss this matter seriously. Does the frequent writing assignment prove 
to be superior to the infrequent one? Of course not; how could it be, 
unless something of substance was studied by the class? Is tiiere any 
difference in student writing depending on whether the English 
teacher has a lay reader? Of course not: again, how could there be, 
unless something of substance was studied by the students? Ability 
grouping, changing (usually limiting) class sizes, alternating grammar 
study with literature study, teacher-student conferences over writing, 
team teaching approaches— most of these experimental invertigations 
suffer from an understandable but fundamentally unsound assump- 
tion. They all assume that the English teacher has some valuable les- 
sons to teach in his composition class, if only certain distractmg real- 
ities could be removed. These distractions invariably are reducible to 
one: the English teacher is overloaded. The more likely assumption is 
that at present, in truth, the English teacher does not have lessons 
of value to teach to Iiis composition students. Without a procedure for 
helping students to write acceptable sentences, no composition pro- 
gram is likely to be significantly better or worse than any other. It is 
consequently not the least surprising that most of these experiments 
have inconclusive results, thou^ frequently they are inaccurately 
reported as having negative results. Readers of research reports must 
be alert for such statistical hyperbole. 

The composition teacher, not having been provided with an 
adequate theory of language (or grammar), is forced to develop or 
secure curricular materials that will stimulate and challenge his 
students to write— hopefully, to write better. Disaffection with inade- 
quate gmmmatical systems has led to the fairly widespread adoption 
of anthologies containing provocative essays which are intended to 
supply both topics for writing assignments and model sentences for 
student emulation. Again the role of the composition teacher becomes 
that of dcadliiie-imposer, critic-reader, and theme grader. He seems to 
be incidental to whatever process it is that transforms a writer of 
fragments or poor sentences into a writer of acceptable prose. And he 
seems to be, unfortunately, a living indictment of researchers’ fail- 
ure to provide even modest support for the building of a suitable com- 
position program. At the very least, such support would include the 
development of an adequate grammatical system. 
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Proc«dur«s 

In order to test the possible efiFects of a study of a generative 
grammar upon pupil writing over a two-year period, the investigators 
selected the ninth grade class at the University School of the Ohio 
State University. The ninth grade, and the following year the tenth 
grade, seemed desirable because these two grades typically place 
the heaviest emphasis on grammatical study in the secondary schools. 
The fifty pupils constituting the ninth grade were assigned randomly 
to two sections. Teachers from the Language Arts Area of the Uni- 
versity School were likewise assigned randomly to the two classes. Both 
teachers were experienced and highly competent; as it happened the 
control teacher had an edge in experience, having served one summer 
as a TV Demonstration Teacher and another as a Master Teacher in 
the Harvard Graduate School of Education. Each class studied what 
would be considered the regular curriculum at the school with this 
exception; die experimental class studied materials specially adapted 
by the investigators from the area of generative grammar. Of the 
original fifty subjects in this two-year project, the experimental class 
lost five and the control class lost four. 

Frequendy when an experimental class receives a substantive 
treatment that the control class does not receive, the investigator has 
serious problems in evaluation. In the new physics curriculum de- 
veloped by the Physical Science Study Committee, for example, 
students are led to discover principles of material forces like energy 
and power through exploration in the laboratory instead of merely 
verifying there the traditional technology they had been taught in 
class. The objectives of the new physics program differ markedly from 
the objectives of the old one; clearly, a sin^e test cannot provide a 
measure for comparing the achievement of pupils pursuing one cur- 
riculmn with that of those pursuing the other. But the teaching of 
generative grammar to the experimental section in this study did not 
complicate the evaluation problem at all. For this substantive treat- 
ment was a means toward the achievement of objectives compatible 
with those of every English composition class: the improvement of 
pupils’ writing. The experimental class was required to learn rather 
thoroughly the special grammatical materials prepared by the invest- 
igators; what the investigators had designed to measure, however, was 
the grammatical quality of the sentences produced by both sections at 
the initial and terminal stages of the experiment. To compute the 
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grammatical quaKty of every sentence written in the samples of prose 
collected, the investigators developed an instrument of transforma- 
tional analysis that could be applied in ? reasonably mechanical way. 

Written compositions were collected from both sections during the 
first three months of the first year and the last three months of the 
second year of the project. Both teachers met regularly with die 
investigators in order to standardize their writing assignments, which 
evolved by design out of their respective classroom concerns. One 
piece of writing was secured from each pupil approximately every 
two weeks during the collecting stages; thus each pupil produced on 
average twelve pieces of writing to be analyzed, six initially and six 
finally. 

Prose Analysis 

The investigators developed an analytical instrument that would 
objectively asiess the grammatical quality of the sentences in the 
sample. According to the generative grammar espoused in this project, 
there are two kinds of sentences in English: kernel and complex. 
Transformational rules are used in order to produce all sentences 
other kernel sentences. It seems possible therefore to describe 
the transformational history of the sentences in the sample by identi- 
fying the specific transformations used to form the complex sentences, 
all other sentences being by definition kernel sentences in this gram- 
matical system. Forty-six transformational rules served to identify the 
grammatical operations that each sentence in the sample reflected. 
These rules are of four types: Embedding, Conjoining, Deleting, and 
Simple, Embedding transformations-the largest type, containing 
thirty-six rules— were further organized according to their specific 
functions: Noun Expansion, Noun Replacement, Adjective Expansion, 
Verb Expansion, Adverbial Replacement, and Adverbial Expansion. 

EMBEDDING TRANSFORMATIONS 

Noon Expansion 

1. Relative Clause (Be): 

I admire my En^ish teacher, who is a scholar. 

2. Adjective (by deletion and obligatory placement): 

A handsome lad. 

3. Relative Clause (Have); 

The book, which had no index, proved useless. 
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4. With-phrase (by simple transfoimation of ET-3): 

A book vHfh an index is needed. 

5. Relative CHause (Vb); 

The boy who scored the touchdown was cheered. 

6. Gerundive Adjective (by deletion and optional placement); 

A smiling girl. 

7. Compounds: He stepped into the btM ring. 

8. Genitives: The horse's mouth/ The mouth of the horse. 

Noun Replacement 

9. That + S as subject; 

That I am failing the course disturbs me. 

10a. (That) S as object; 

I know he is a diligent student. 

10b. That + S as object: 

I believe that he has made the team. 

11. WH + S as subject; 

What he has already learned astonishes me. 

12. WH + S as object: 

I know what annoys him. 

13. WH + Inf as subject; 

What to visit at the Fair is a problem. 

14. WH + Inf as object: 

My cousin knows what to visit. 

15. Nominal Inf of Obligation: 

Here is a book for you to know. 

16. Inf as subject: 

To appear on television is an exciting experience. 

17. Inf as object: 

I tried to answer the question correctly. 

18. Inf of purpose: 

The exercises are designed to help you. 

19. Gerundive Nominal: 

Tom's hot~rodding disturbed his mother./ She objected to 
his continuous complaining. 

20. Gerundive Nominal of Purpose; 

I have a knack for getting into trouble. 

21. Abstractive Nominal. 

His eagerness to depart surprised me./ I admired the girVs 
reluctance to go. 
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ADjxcnrxvE Expahsjion 

22, Adjective + Inf; You are free to an oduoaHon, 

23, Adjective + iTmt-diauee; I am happy that you ham ornddad. 

24, Adjective + Gerundive: Lures are excallent for artcAMg fisA. 



Vkrb Expansion 


25. Vt.: 


I oougJfrf him stealing the mormy. 


26. VTbt 


I prevented him from stealing the money. 


27. Vtc: 


I advised him to return the money. 


28, Vxd: 


I considered him to be the thief. 


29. Vt.: 


I let him return the money. 


30. V„: 


I coded him a fool. 


31. Vt,: 


I made him angry. 


32. Vti»: 


I put the car in the garage. 


33. Vin + C; 1 kept on talking. 



Adverbial Reflacxmsnt 

34. Adverbial Replacement in Loc, Tm, Mot, or Man: 

You may go wherever you wish, 

35. Adverbial Replacement ( 4 ) : 

He is Happy because she smUed at him. 

Adverbial Expansion 

36. Adverbial Expansion of Man + 

The lawyer spolce so rapidly that he confused the jury, 

CONJOINING TRANSFORMATIONS 

37. Conjoining; The boat sank but nobody drowned. 

DELETING TRANSFORMATIONS 

38. Common elements ddletion; 

His lonely hotel room se^ed cold and his lonely hotel room 
seemed damp. 

39. WH + BE deletion; The boy who is starting at quarterback 

is in my class. 

40. AdverbisJ embedment deletion; 

As if he had been asked, he sat down to dinner with us. 
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SIMPLE TRANSFORMATIONS 

4X* Pflissivct 

Tbe boy hit the haU-The ball was hit (by the boy). 

42. It-Inversioiu It is surprising that we won the game. 

43. There-Inverslon; There is a thief among us. 

44. Question: Are you going to the game tomorrow? 

45. Negation; He did not see the mirage in the desert. 

46. Negation-shift: 

I advised him not to enroll-I didn’t (did not) advise him to 
enroll. 

These forty-six grammatical structures are instrumental in the 
sentence evaluation techniques developed in the project, for they 
provide various scores for measuring the grammatical changes oc- 
curring over the two-year period in the pupils writing. These struc- 
tures, moreover, can be identified quite objectively in a sample of prose 
by analysts; and of course it is the use of these structures in writing 
that is measured—not the pupil’s awareness of or ability to recall their 
labels. This particular means of sentence evaluation, therefore, is 
applicable to the writing produced in both the control and the ei^eri- 
mental classes. It measures the grammatical quality of writing inde- 
pendent of the instruction accorded each class. 

SENTENCE EVALUATION TECHNIQUES 

The Sentence Evaluation Techniques (SET) consist of three 
component scores: 

1. Structural Complexity Score (SCS) 

2. Proportion of Well-Formed Sentences (PWF) 

3. Error Change Score (ECS) 

The SCS indicates the grammatical or structural richness of the sen- 
tences produced in the experiment; the PWF reveals the ratio of 
acceptable to unacceptable sentences; and the ECS shows the trend 
in the frequency and kinds of grammatical misoperations that oc- 
curred in pupil writing. 

Structural Complexity Score 

The forty-six transformations identified in the generative grammar 
adapted for this study were used to reconstruct the transformational 
history of every grammatical sentence in the prose sample. This pro- 
cess of reconstruction reverses the proper grammatical^function of the 
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transfoimations, whose efiFect is regularly to create new sentences 
rath^ than to analyze ones already produced. When sentences have 
been properly— that is, grammatically— formed, however, they can 
routinely be reduced to the kernel sentences from which they have 
been produced; and the transformations that have been applied can 
likewise be identified. The number of grammatical pperatimis that 
have taken place in a particular sentence then, becomes a score that 
characterizes the structural complexity of that sentence. The lowest 
possible score is J, which has been assigned to a kernel sentence; the 
score for a complex sentence becomes 1 + the number of transfor- 
motions it contains. Thus a sentence using two embedding transfor- 
mations, one conjoining transformation, and one simple transfor- 
mation receives an SCS of 5. The following s^tences, excerpted 
from the sample, illustrate further the computing of the SCS; the 
number in parentheses indicates the SCS, and the number above a 
particular word identifies one of the transfcrmaticms as listed on pages 
Stoll: 

( 1 ) The rain splattered at the window. 

29 

(3) Then at long last I could see the smoke rise from the 
chinmey of my house. 

84 7 

(5) As these thou^ts passed throu^ my now-numbed brain, I 

45 2 

did not notice the dull rumbling in the distance. 

1.89 87,88 7 7 

(7) Her hands, long and delicate-looking, have almond- 
shaped fingernails. 

(11) Finally fhe pawns, whose initiative and number provide a 

« 2 87,88 « 

pattern of battle, are the brave protecting agents 
of the more powerful forces of the army, despite 
their lack of sfeength. 

After every sentence was analyzed in this manner, the mean struc- 
tural complexity score was computed for Before and After well-formed 
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and malfonned sentences for «idb pupil. The principal comparison 
was then made by analysis of variance applied to the ^lins scores. 

Tabulating the specific transformations that occurred in every 
sentence of the sample made additional comparisons possible. What 
class of transformations— among the eight identified in the analytical 
instrument— was relied upon most heavily, for example? Whildi 
showed the greatest change between ihe Before-writing and the After- 
writing? 

Proportion of WoU-iormed Sentences 

The proportion of well-formed sentences was obtained by dividing 
the total number of sentences into the number of well-formed sen- 
tences for each subject in ihe study. To be considered 'well-formed, a 
sentence had to be both intuitively acceptable to the andysts and 
derivable from the rules of the grammar. Before a sentence was con- 
sidered not well-formed, the analysts had to demonstrate that it could 
not be derived from ihe rules, \iliether a sentence was well-formed 
or malformed, however, it was analyzed and assigned a stmctiural 
complexity score. The following excerpt from one subject’s prose il- 
lustrates how this part of the analysis was carried out; 



8 10a 4S S 

(7) Later that day Irea’s Mother said, “There’s a little girl 

B.M 



outside waiting for you.” 



4S 



(1) Irea looked outside. (3) Yes, there was a little girl. 



84 



27 



(6) \^en Irea stepped outside, she expected the little girl 



87 



46 



87* 



to go home, but she didn’t. (10* ) They played all afternoon, 

84 2 8 1.89 2 

when the little girl’s mother came, Susie (the little girl) 

12 87 

asked if Irea could spend the ni^t and that was fine. (5) 

84 4S 87 8 ^ 

As Irea got into the car, she couldn’t believe her eyes; Susie’s 

87* 

father was Negro also. (3*) Now Irea belonged somewhere, 

85 2 

she had a real friend. 
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The number in parentheses preceding each smitence indicates the 
SCS for that sentence; the number above a particular word identifies 
the transformation being used. An asterisk following an SGS indicates 
a malformed sentence; an asterisk following a transformation number 
indicates that the transformation was misapplied. Of the seven sen- 
tences presented above, the five well-formed sentences have SCS^s of 
(7),^ (1), (3), (6), and (5); rnd the two malformed sentence have 
SGSs of (10*) and (3*), In the first malformed sentence, the 37* 
indicates that the conjoining transformation was not properly applied 
though one was needed; in the second malformed sentence, the 37*- 
35 indicates that a csonjoining transformation was improperly used for 
an abverbial replacement. Dividing the total number of sentences into 
the number of well-formed sentences in this severely limited example 
produces a PWF (Proportion of Well-formed Sentences) of .714. 

Error Change Score 

These five classes of errors-or grammatical misoperations-were 
identified and tabulated: 

1. Misapplication of a transformational operation. 

2. Use of One transformation when another is required. 

3. Use of a transformation when none should have been used. 

4. Omission of a required transformation. 

5. Go-occurrence error; the use of mutally exclusive grammatical 
elements in kernel sentences or in kernel sentences underlying 
complex sentences. 

Brief examples of the various classes of errors should be useful. 

Class 1 Erbor: In the sentence, "While Carson Drew was 

working on a case, he sometimes let his 
daughter help hrm, who does a very good 
job. Transformation 5 has been misapplied. 
The placement of the relative clause must 
come directly after daughter. 

Class 2 Error; Sentence (3*) above confc'.ins a Class 2 Er- 
ror. The conjoining transformation was used 
instead of an adverbial replacement; one 
way of handling the sentence grammatically 
would have been to replace the comma with 
because. 
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rVtAS-s 3 Ebrob: In the sentence, “Such ideas have and can be 

found in many books,’* a common element 
deletion— Transformation 38— has been ap- 
plied to remove been after have. This trans- 
formation should not have been used. 



Class 4 Ebrob: In tbe sentence, “He always looks dean 

though that’s one thing in his favor,” a con- 
joining transformation is omitted. A semi- 
colon after though would have made the 
sentence grammatically acceptable. 

Class 5 Error: In the sentence, “As a youth, he was averse 

from reading his school assignments,” averse 
from should have been averse to. A fragment 
like “The leaves falling from the trees,” 
which does not have the complete verb 
phrase required by the phrase structure rules, 
also exemplifies this class of errors. 

After all the occurrences of errors were identified for each subject in 
the study, the Before-scores were compared with the After-scores to 
determine what changtis in error reduction had taken place. 
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The Writing Semple 



Samples of writing were collected throughout the two-year pe- 
riod of the experiment. Approximately 70,000 words were analyzed; 
Before-samples were collected during the first three months of the 
experiment and After-samples were collected during the last three 
months. All writing was produced by the pupils as part of class assign- 
ments. In each class, improvement in pupil writing was one of the 
major objectives. The classes differed only in content: no formal gram- 
mar was studied in the control class; the grammatical content 
summarized in Chapter 1 was studied by the pupils in the experimental 
class. 



Table 1 

Total Words in Samples of Writing 

Centrel Class Exparimantal Class 
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1 


631 


1687 


2318 


1 
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2092 


2 


498 


490 


988 


2 


1233 


722 


1955 


3 


1258 


732 


1990 


3 
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765 


2609 


4 


1057 


706 


1763 


4 


989 


673 


1662 


5 


707 


980 


1687 


5 


1357 
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2361 


6 


673 
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1410 


6 


965 
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1664 


7 


653 


1040 


1693 


7 


705 


268 


973 


8 


674 
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1249 


8 


1417 


894 


2311 


9 
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1065 
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9 
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951 


1728 


10 


706 
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1422 


10 


1162 


823 
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11 
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1532 


11 


1105 


1120 


2225 


12 


688 


1038 


1726 


12 


915 


390 


1305 


13 
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1369 


13 


1062 


1103 


2165 


14 
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1356 


1976 


14 


530 


853 


1383 


15 
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15 
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799 
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16 
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16 
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2464 


17 
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17 
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18 
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18 
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1537 


19 
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19 
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1334 


20 


1069 


660 


1729 


20 


754 


803 


1557 










21 
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570 


1120 


Totals 


15,129 


18,302 


33,431 




20,209 


17,183 


37,392 
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The analysis of the prose consisted of a recaostructUm of the 
transformational history of each sentence. A well-formed sentence 
had to be not only intuitively acceptable to the analysts but also 
grammatically derivable. A maUormed sentence had to be not only 
intuitively unacceptable but also grammatically underivable. Analyti- 
cal proc^tures were made as mechanic^ as possible. Summaries of 
frequencies of words, sentences, and transformations are presented in 
Tables 1 and 2. 

StiTVctural Complexity Scorns 

Each sentence in the sample was assigned a structural cmn- 
plexity score which represents the total number of grammatical 
operations it has taken to produce the sentence. Average structural 
complexity scores are preseated in Tables 3 and 5. 

The increase in average structural complexity scores for wdl- 
formed sentences was 3.793 for the control class and 9.315 for the 
experimental dass. A difference of over 5 grammatical operations 
per sentence seems to indicate that the experimental class had 
significantly extended its capacity for producing complex well-formed 
sentences. However, a closer examination reveals that the greatest 
changes were made by only four students, one of whom shows a 
structural complexity increase of 64.741. 
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T«bl« 3 

Avtris* SHruchiral ComfiJaxfty $cort« for Wtll<lenii«d SmiNmicm 



Cwrtf»l Clu 





■afNr* 


Altar 


ClHMIf* 




Itlera 


AfW 




1 


8.791 


27.300 


+18.509 


1 


8,305 


11.198 


+ 2.893 


2 


8.162 


11.759 


+ 3.597 


2 


9.516 


14.640 


+ 5.124 


3 


6.298 


9.744 


+ 3.446 


3 


8.510 


13.727 


+ 5.217 


4 


5.333 


11.333 


+ 6.000 


4 


5.382 


6.836 


+ 1.454 


5 


5.796 


7.732 


+ 1.986 


5 


5.845 


10.942 


+ 5.097 


6 


7.190 


6.842 


- .348 


6 


7.908 


10.986 


+ 3.078 


7 


7.903 


10.710 


+ 2.807 


7 


8.340 


8.126 


- .214 


8 


4.972 


7.851 


+ 2.879 


8 


7.449 


29.800 


+22.351 


9 


8.086 


10.526 


+ 2.440 


9 


6.942 


13.300 


+ 6.358 


10 


7.571 


5.077 


- 2.494 


10 


5.521 


9.080 


+ 3.559 


11 


6.196 


8.786 


+ 2.590 


11 


8.822 


24.951 


+iai29 


12 


5.753 


12.360 


+ 6,607 


12 


7.702 


6.167 


- 1.535 


13 


6.740 


11.322 


+ 4.582 


13 


7.956 


11.470 


+ 3.514 


14 


5.103 


13.896 


+ 8.793 


14 


6.095 


8.008 


+ 1.913 


15 


5.917 


8.645 


+ 2.728 


15 


7.624 


39.343 


+31.810 


16 


6.378 


15.051 


+ 8.673 


16 


14.870 


14.280 


- .m 


17 


10.148 


13.688 


+ 3.540 


17 


5.576 


8.217 


+ 2.641 


18 


7.278 


9.112 


+ 1.834 


18 


5.966 


70.707 


+64.741 


19 


7.288 


8.164 


+ .876 


19 


5.969 


13.476 


+ 7.507 


20 


9.270 


6.143 


- 3.127 


20 


5.871 


8.770 


+ 2,899 










21 


3.347 


15.014 


+11.667 


Average 


7.009 


10.802 


+ 3.793 




7.310 


16.625 


+ 9.315 



Statistical evalnatioD (rf change in average structural complexity 
scores for well-formed sentences by analysis of variance provides only 
minimal support for any contenticm that the increased average com- 
plexity scores in the experimental class can be attributed to the study 
of generative grammar. 



Tibi* 4 

Wtll-formtd Stnictural Comploxity Scores: Statistical Summary 



S*urc« 


df 


ss 


MS 


F 


D 


1 


192.15 


192.15 


3.01 


S’s w/gps. 


39 


2490.13 


68.85 




A 


1 


898.81 


898.81 


28.47** 


Ax S’s 


78 


2462.77 


156.16 


4.95* 


AxD 


1 


156.16 


31.57 





*Significant at the .05 levd. A: Before and After Scores 

**Significant at tibe .01 level. D: C!ontrol and Experimental Classes 
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Findings; 



COMMKNTS: 



1) Statistical analysis fails to indicate a sign i fic a n t 
diffenmce between ibe control and experi- 
mental dassos. (D) 

2) Before and After Gains Scores are significantly 
different at the .01 level (A) 

3) Hie interaction between (a) Before and After 
Gains Scores and (b) experioiental and control 
classes is significant at the .OS level (A x D) 

1 ) Increase in average structural complexity scores 
is significantly different when Bef'" to and After 
scores are ewnpared independently of control 
and experimental groups. Both classes have in- 
creased capacities for producing sentences of 
greater complexity. 

2) That the A X D interaction score is significant 
at the .05 levd indicates diat increase in struc- 
tural complexity semes depends not only on 
when a sample was written but also on whether 
it was written in the experimental or the con- 
trol dass. 

3) Though there is a suggestion that the gieater 
gain in average structural complexity score for 
the experimental class is dependent on the 
study of the grammar, the failure of the sta- 
tistical analysis to indicate a significant differ- 
ence between the two classes (D) considerably 
weakens this contention. 



The increase in average structural complexity scores for mal- 
formed sentences was 7.511 for the control class and 3.585 for the ex- 
perimental dass. Table 5 indicates that as both dasses learned to 
write well-formed sentences of increased complexity they also in- 
creased the average structural complexity of malformed sentences, 
thou^ the experimental dass was better able to hold this tendency 
in chedc. 
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Ta bb 5 

Avaraflt Stniclaral CompbxMy Scerat for Malformad Sanfoiicaf 



C«wtrtl Cfam f> c p t ri w n w|i>l Ct— 





l«fM« 


Afftr 


diMfi# 




WWiwfV 


After 


CllMf* 


1 


7.882 


76,307 


+ea425 


1 


9.973 


a800 


- 1.173 


2 


10.000 


19.795 


+ 9.795 


2 


14.533 


12.392 


- 2.141 


3 


8.379 


9.411 


+ 1.032 


3 


12.553 


13.233 


+ .680 


4 


9.375 


13.667 


+ 4.292 


4 


7.103 


5.692 


- 1.411 


5 


10.148 


11.765 


+ 1.617 


5 


13.429 


10.718 


- .'2.711 


6 


14.556 


9.250 


- 5.306 


6 


aS59 


12.111 


+ 5.252 


7 


9.711 


21.298 


+11.587 


7 


13.073 


5.000 


- a073 


8 


10.044 


21.612 


+11.568 


8 


11.678 


4.000 


- 7.678 


9 


14.621 


15.757 


+ 1.136 


9 


6,845 


7.640 


+ .795 


10 


7.224 


15.528 


+ 8.304 


10 


14.056 


7.310 


- 6.746 


11 


9.515 


11,217 


+ 1.702 


11 


10.045 


36,650 


+26,605 


12 


9.589 


20.381 


+10.792 


12 


a385 


7.792 


+ 1.407 


13 


12.013 


6.733 


- 5.280 


13 


10.415 


29.772 


+19.357 


14 


7.986 


12.982 


+ 4.996 


14 


8,960 


19.443 


+10.483 


15 


8.337 


11.036 


+ 2.^ 


15 


8.032 


12.829 


+ 4,797 


16 


16.658 


24.717 


+ 8.059 


16 


14.092 


laooo 


+ 3.908 


17 


11.819 


17.353 


+ 5.534 


17 


12.409 


3.000 


- 9.409 


18 


9.611 


10.353 


+ .742 


18 


2,667 


4.400 


+ 1.753 


19 


ai54 


10.706 


+ 2.552 


19 


8.746 


24.812 


+16.066 


20 


7.045 


13.023 


+ 5.978 


20 


7.200 


25.792 


+18,592 










21 


5.000 


9.965 


+ 4.965 


Average 10.133 


17.644 


+ 7.511 




9.717 


13.302 


+ 3.585 



Statistical analysis of average structural complexity scores 
malformed sentences is unambiguous. 



Table 6 



Malformad Structural Complexity Scores: Statistical Summary 



Sewrce 


4t 


ss 


MS 


P 


D 


1 


115.98 


115.98 


1.50 


S's w/gps. 


39 


3005.15 


77.06 


* 


A 


1 


620.24 


620.24 


12.02** 


A X D 


1 


78.93 


78.93 


1.53 


A X S’s 


78 


4026.16 


51.62 





*S9gnificuit at tibe .05 levd. A: Before and After Scores 

**Significant at the .01 level D: Experimental and Ckmtrol Glasses 
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FiNMNOSj 1) The analysif fails to show a significjant difEer- 

ence between the control and esperimcotal 
dasses. (D) 

2) Before and After Gains scores are significantly 
different at the .01 level. (A) 

3) The interaction between (a) Before and Af- 
ter Gains scores and (b) experimental and con- 
trol classes is not significant. (A x D) 

Comments: 1) Increase in average structural complexity 

scores for malformed sentences is significantly 
different when Befoire and After sccwes are 
compared independently of control and ex- 
perimental dasses. Bolh classes have increased 
average structural complexity scores signifi- 
cantly. 

2) Since the analysis fails to show eidier a signif- 
icant difference between the two dasses (D) 
or a significant interaction effect (A x D), 
change in average structural complexity scores 
for malformed sentences cannot be said to be 
dependent upon the study of the grammar. 

Proportion of Woll-formod Sontoncos 

Table 7 shows change in jj^oportion of well-tormed sentences. 
For the ccmtrol dass there is an increase of 3.5 percent; for the ex- 
perimental class, 31.8 percent It might seem unusual that the per- 
centages of wen-formed sentences in the Before writing were not 
hi^er (59.5% for the control dass and 55.9% for the experimental 
dass). These relatively low percentages reflect the rigor of the crite^ 
for weU-formedness. Customary compositional admonishments indude 
such inexpndt judgments as “awkward,'' “vague," and other und^ 
fined term» that identify the grader's intuitive recognition of mal- 
formedness. In the analysis of the prose samples in this study, explidt 
grammatical demonstrations of intuitions of malformedness were re- 
quired li was not enough to recognize that a sentence was not well- 
formed: tibe exact character of the malformedness had to be ex- 
plidlly attributed to malfunctions of phrase structure or trans- 
formational operations. A careful and detailed classification of erroK 
led to a diaracterization of malformedness. 
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Tabl« 7 

Chang* in Proportion of W*ll>formod Sontoncoi 



Cuffl Cl»tt Ixptriiiiiitail €!«>■ 







Af»#r P 


ChMig« 




kf«r«P 


Afl«r P 


Chmi* 


1 


.639 


.811 


-I-.172 


1 


.569 


.946 


+.3^ 


2 


.786 


.720 


-.066 


2 


.419 


.828 


+.409 


3 


.455 


.588 


-|-.133 


3 


.500 


.692 


+.192 


4 


.750 


.438 


-.312 


4 


.671 


.945 


+.274 


5 


.517 


.633 


-I-.116 


5 


.426 


.804 


+.378 


6 


.677 


.564 


-.113 


6 


.490 


.838 


+.348 


7 


.645 


.553 


-.092 


7 


.345 


.960 


+.615 


8 


.717 


.605 


-.112 


8 


.610 


.977 


+.367 


9 


.568 


.667 


-I-.099 


9 


.604 


.962 


+.358 


10 


.674 


.692 


+.018 


10 


.357 


.897 


+.540 


11 


.412 


.596 


+.184 


11 


.776 


.939 


+.163 


12 


.488 


.614 


+.126 


12 


.692 


.710 


+.018 


13 


.438 


.620 


+.182 


13 


.704 


.922 


+.218 


14 


.625 


.808 


+.183 


14 


.300 


.725 


+.425 


15 


.581 


.483 


-.098 


15 


.5^41 


.750 


+.209 


16 


.613 


.436 


-.177 


16 


.830 


.978 


+.148 


17 


.469 


.605 


+.136 


17 


.561 


.985 


+.424 


18 


.581 


.694 


+.113 


18 


.933 


.961 


+.028 


19 


.809 


.707 


-.102 


19 


.303 


.913 


+.610 


20 


.452 


.765 


+.313 


20 


.575 


.933 


+.358 










21 


.529 


.750 


+.221 


Average. 595 


.630 


+.035 




.559 


.877 


+.318 



Analysis of variance applied to the gains scores for proportion of 
well-formed sentences provides the most unambiguous condusions of 
the study. 



Table 8 



Proportion of Weli*formed Sentences: Statistical Summary 



S«Mrc« 


df 


ss 


MS 


F 


D 


1 


1.68 


1.68 


15.27^^ 


S*s w/gps. 


39 


4.34 


.11 




A 


1 


3.82 


3.82 


119.38^^ 


AxD 


1 


2.56 


2.56 


80.00^^ 


AxS’s 


78 


2.50 


.032 ■ 




•Significant at the .05 level. 




A: Before and After Scores 


••Significant at the .01 level 




D: E:q;>eiimental and Control Glasses 
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Findings: 



Comments: 



1) There is a significant difference between the 
control and experimental classes at the .01 level. 

(D) 

2) There is a significant difference between die 
Before and After scores at the .01 level. (A) 

3) There is a significant interaction at the .01 
level between (a) the Before and After scores 
and (b) the control and experimental classes. 

1) The increajied production of well-formed sen- 
tences by tiae experimental class is significantly 
greater Aan that of the control class. 

2) The significant difference in the gains scores 
for proportion of well-formed sentences can un- 
ambiguously be attributed to die study of the 
grammar by the experimental class. 



Error Change Scores 

Tables 9-12 present changes in the frequency of the five classes 
of errors and total errors. Since the number of Before-sentences for 
both control and experimental classes is unequal to die After-sen- 
tences, die Before-frequencies for both classes have been adjusted so 
that Before-and After-tabulations can be meaningfully compared. 
Errors were classified as follows: 



1. Misapplication of a transformational operation. 

2. Use of one transformation when another is required. 

3. Use of a transformation when none should have been used. 

4. Omission of a required transformation. 

5. Co-occurrence error: the use of mutually exclusive grammatical 
elements in kernel sentences or in kernel sentences underlying 
complex sentences. 



Class 1 Errors 

Table 9 shows Before- (adjusted) and After-fi*equencies of Class 
1 Errors for control and experimental classes. Both classes were clearly 
able to reduce frequency of Class 1 Errors substantially. Average re- 
duction for the control class was 8.9 (39.82%) and for the experimental 
class 13.67 (79.06%). The greater reduction made by die experimental 
class would appear to be clearly significant, tiiough statistical analysis 
is not unambiguous. 
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Tabl« 9 

Chang* in Fraquancy of Class 1 irrors 



Cnt>d CUi> ixlwriiiwifil Claw 





■•fw* 


After 


ChMif* 




l*fw* 


After 


Chans* 


1 


19 


6 


- 13 


1 


15 


3 


- 12 


2 


13 


5 


- 8 


2 


32 


5 


- 27 


3 


47 


20 


- 27 


3 


31 


6 


- 25 


4 


27 


16 


- 11 


4 


21 


3 


- 18 


5 


27 


13 


- 14 


5 


35 


5 


- 30 


6 


19 


17 


- 2 


6 


29 


4 


- 25 


7 


8 


21 


+ 13 


7 


25 


1 


- 24 


8 


15 


7 


- 8 


8 


17 


1 


- 16 


9 


24 


14 


- 10 


9 


10 


1 


- 9 


10 


16 


8 


- 8 


10 


33 


2 


- 31 


11 


35 


14 


- 21 


11 


5 


2 


- 3 


12 


34 


11 


- 23 


12 


8 


2 


- 6 


13 


31 


22 


- 9 


13 


14 


4 


- 10 


14 


19 


3 


- 16 


14 


16 


15 


- 1 


15 


11 


15 


+ 4 


15 


10 


9 


- 1 


16 


15 


32 


+ 17 


16 


9 


1 


- 8 


17 


16 


14 


- 2 


17 


20 


1 


- 19 


18 


23 


11 


- 12 


18 


2 


1 


- 1 


19 


6 


10 


+ 4 


19 


14 


3 


- 11 


20 


42 


10 


- 32 


20 


10 


2 


- 8 










21 


7 


5 


- 2 


Totals 


447 


269 


-178 




363 


76 


-287 


Average 


22.35 


13.45 


-8.9 




17.29 


3.62 


-13.67 


Percent of Error Reduction: 39.82% 






79.06% 








Tabla 10 








Error Changa Scoras (Class 1): Statistical Summary 




Swire* 




df 


ss 




MS 




s 


A 


2586.266 


1 


2586.266 




33.536** 


S (CD) 


2930.521 


38 




77.119 






D 


1094.934 


1 


1094.934 




16.831** 


AxD 


115.286 


1 




115.286 




1.772 


AxS(CD) 2472.040 


38 




65.054 






Total 


9199.046 


79 










*Slgnificant at the .05 level. 




A: Before and After Scores 


**Significant at the .01 level. 




D: Experimental and Control Glasses 
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Findings: 



C!omments: 



1) Before and After Gains Scores are significant 
at die .01 level. (A) 

2) There is a significant difference at the .01 level 
between the control and the experimental 
classes. (D) 

3) The analysis fails to show a significant inter- 
action between (a) die Before and After scores 
and (b) the experimental and control classes. 

1) Decrease in production of Class 1 Errors is sig- 
nificandy different when Before and After 
scores are compared independently of control 
and experimental groups. 

2) Even thou^ die control and experimental 
classes differ significandy, die absence of a sig- 
nificant interaction weakens any contention that 
the experimental class’s greater reduction of 
Class 1 Errors was a result of studying the 
grammar. 

3) The clear relationship betvreen increase in pro- 
portion of well-formed sentences and decrease 
in error production substantially supports die 
contention diat the greater change of the ex- 
perimental class is attributable to its study of 
die grammar. 



Class 2, 3, and 4 Errors 

The relative infrequency of errors in fbese classes suggested that 
statistical analysis would be undesirable. Table 11 shows Before- (ad- 
justed) and After-frequencies of Class 2, 3, and 4 Errors. Class 2 Error 
reduction is the same for the experimental and control classes; the ex- 
perimental class made considerably more Class 3 Errors in the 
Before-writing than die control class, though most of these errors were 
eliminated in the After-writing; die control class made considerably 
more Class 4 Errors than the experimental class, thou^ it substantially 
reduced them in die After-writing. The lack of correspondence be- 
tween Class 3 and 4 Before Errors makes any kind of comparison of 
the experimental and control classes impossible. 
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Tabh 11 

Change in Frequency of Class 1, 3, and 4 Errors 



Contrail Class 
■oforo After 


ChanM 


Exporimontal Clast 
■oforo After 


Chang# 


37 


15 


-22 


38 


16 


-22 


18 


15 


- 3 


43 


5 


-38 


61 


14 


-47 


6 


14 


+ 8 



Class 5 Errors 

Table 12 shows Before- (adjusted) and After-frequencies of 
Class 5 Errors for control and experimental classes. Both the 
experimental and the control classes were able to reduce fre- 
quency of Class 5 Errors substantially. Average reduction for the con- 
trol class was 6.55 (51.78%) and for the experimental class 10.48 
(91.29%). The greater reduction made by the experimental class 
would appear to be clearly significant, though statistical analysis is 
again not imambiguous. 

Table 12 



Change in Frequency of Class 5 Errors 

Control Clan Exporiwontal Clast 





■oforo 


After 


Chang# 




■oforo 


After 


Chang# 


1 


3 


2 


- 1 


1 


10 


0 


-10 


2 


8 


7 


- 1 


2 


25 


0 


-25 


3 


13 


1 


-12 


3 


18 


2 


-16 


4 


13 


3 


-10 


4 


14 


1 


-13 


5 


13 


12 


- 1 


5 


23 


1 


-22 


6 


8 


8 


0 


6 


7 


0 


- 7 


7 


3 


7 


+ 4 


7 


8 


0 


- 8 


8 


11 


12 


+ 1 


8 


14 


0 


-14 


9 


0 


5 


+ 5 


9 


13 


0 


-13 


10 


15 


•5 


-10 


10 


15 


0 


-15 


11 


31 


4 


-27 


11 


7 


0 


- 7 


12 


16 


8 


- 8 


12 


6 


5 


- 1 


13 


11 


5 


- 6 


13 


6 


0 


- 6 


14 


:i 


6 


- 5 


14 


15 


3 


-12 


15 


10 


6 


- 4 


15 


15 


2 


-13 


16 


15 


3 


-12 


16 


0 


0 


0 


17 


13 


4 


- 9 


17 


8 


0 


- 8 


18 


15 


17 


+ 2 


18 


0 


1 


+ 1 


19 


5 


4 


- 1 


19 


10 


1 


- 9 


20 


39 


3 


-36 


20 


7 


2 


- 5 










21 


20 


3 


-17 


Total 


253 


122 


-131 




241 


21 


-220 


Average 


12.65 


6.1 


-6.55 




11.48 


1 


-10.48 


Percent of Error Reduction: 51.78% 








91.29% 
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Table 13 

Error Change Scores (Class 5): Statistical Summary 



Sourc* SS df MS F 



A 


1433.362 


1 


1433.362 


41.509^^ 


S (CD) 


1312.175 


38 


34.531 




D 


187.970 


1 


187.970 


5.126* 


AxD 


78.749 


1 


78.749 


2.148 


A X S (CD) 


1393.447 


38 


36.670 




Total 


4405.703 


79 







*Significant at the .05 level. A; Before and After Scores 

••Significant at the .01 level. D: Experimental and Control Glasses 



Findings: 



Comments: 



1 ) There is a significant difference between the Be- 
fore and After scores at the .01 level. (A) 

2) There is a significant difference between the 
control and experimental glasses at the .05 level. 

(D) 

3) The analysis fails to show a significant inter- 
action between (a) the Bofore and After 
scores and (b) the control and the experi- 
mental classes. (A x D) 

1) Decrease in production of Class 5 Errors is 
significant when Before and After scores are 
compared independently of experimental and 
control classes. 

2) Even though the control and experimental 
classes differ significantly at the .05 level, the 
absence of a significant interaction weakens 
any contention that the experimental class’s 
greater reduction of Class 5 Errors is a result 
of studying the grammar. 

3) The clear relation^jp between increase in pro- 
portion of wc- ' Ji^d sentences and decrease 
in error production substantially supports the 
contention that the greater change of the ex- 
perimental class is attributable to its study of 
the grammar. The greater significance of dif- 
ference between the experimental class and 
the control class in respect to Class 1 Errors 
(.01) as opposed to Class 5 Errors (.05) 
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suggests that the study of the grammar is more 
directly related to tibe reduction of Class 1 
Errors. This tentative conclusion would receive 
logical support in that many co-occurrence 
errors seem to be pregrammatical, involving 
a failure on the part of the writer to channel 
a partially formed idea through the grammat- 
ical component of his sentence generating de- 
vice. 

Total Errors 

Table 14 shows Before- (adjusted) and After-frequencies of 
total errors. The control class reduced errors by 46.63 percent and the 
experimental class by 80.86 percent. As in the case of both Class 1 
and Class 5 Errors, statistical analysis of Total Errors does not yield 
unambiguous results. 

Table 14 

Change in Frequency of Total Errors 

Control Cla«t Exporimontai CUt« 





Baforo 


Aftor 


Chango 




Baforo 


Aftar 


Chango 


1 


29 


9 


-20 


1 


31 


4 


-27 


2 


21 


12 


- 9 


2 


61 


7 


-54 


3 


82 


21 


-61 


3 


53 


9 


-44 


4 


44 


22 


-22 


4 


38 


5 


-33 


5 


45 


27 


-18 


5 


59 


10 


-49 


6 


32 


29 


- 3 


6 


38 


6 


-32 


7 


24 


28 


+ 4 


7 


37 


2 


-35 


8 


29 


20 


- 9 


8 


37 


1 


-36 


9 


29 


22 


- 7 


9 


25 


2 


-23 


10 


32 


17 


-15 


10 


55 


6 


-49 


11 


77 


21 


-56 


11 


11 


4 


-10 


12 


55 


25 


-30 


12 


18 


11 


- 7 


13 


47 


27 


-20 


13 


24 


7 


-17 


14 


34 


10 


-24 


14 


33 


21 


-12 


15 


26 


45 


+19 


15 


29 


15 


-14 


16 


32 


18 


-14 


16 


9 


1 


- 8 


17 


47 


17 


-30 


17 


28 


1 


-27 


18 


35 


34 


- 1 


18 


2 


2 


0 


19 


13 


17 


+ 4 


19 


41 


5 


-36 


20 


82 


14 


-68 


20 


22 


4 


-18 










21 


36 


9 


-27 


Totals 


; 815 


435 


-380 




690 


132 


-558 


Average 40.75 


21.75 


-19.0 




32.86 


6.29 


-26.57 



Percent of Error Reduction: 46.63% 80.86% 
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Tabl« 15 

Error Chongo Scortt (Toni): Statiftkal Sumnuiry 



Sawrct 


«if 


ss 


MS 


f 


c 


4 


11022.898 


2755.725 


111.812^* 


D 


1 


538.770 


538.770 


21.860** 


CxD 


4 


786.086 


196.522 


7,973** 


S’s w/gps 


190 


4682.731 


24.646 




A 


1 


2079.944 


2079.944 


91.018** 


C X A 


4 


1998.374 


499.594 


21.862** 


Dx A 


1 


56.078 


56.078 


2.453 


C X Dx A 


4 


188.516 


47.129 


2.062 


A X S’s w/gps 


190 


4341.808 


22.852 





•Significant at the .05 level. A; Before and After Score# 

••Significant at the .01 levd. D; Experimental and Contwn Ctaise# 



Findings; 1 ) There are significant differences among the five 

classes of errors at the .01 leveL (C) 

2) There is a significant difference between the 
experimental and control classes at the .01 
level. (D) 

3) There is a significant interactimi between (a) 
the classes of errors and (b) the experiment 
and control classes at the .01 level (G x D) 

4) There is a significant difference between the 
Before and After scores at the .01 level (A) 

5) There is a significant interactimi between (a) 
the dasses of errors and (b) the Before and 
After scores at the .01 levd. (A x C) 

6) There is no significant interaction between (a) 
the experimental and control dass^ and (b) 
the Before and After scores. (D x A) 

7) There is no significant interaction between (a) 
die classes of errors, (b) the control and ex- 
perimental classes, and (c) the Before and 
After scores. (C x D x A) 

Comments: 1) Much the same comment can be made here 

as was made in regard to Class 1 and Clas<v 5 
Error reduction. The dear relationship between 
increase in proportion of well-formedl sentences 
and decrease in error production substantially 
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supports the contention that tihe greater change 
of the experimental class is attributable to its 
study of grammar. The statistical analysis of 
total errors i*" somewhat obfuscated by the fact 
that the classes of errors factor (C) is a com- 
plex factor (xmsisting of five subclasses. Conse- 
quently, significant differences are dependent 
not only on Before and After scores of experi- 
mental and control classes but also on the nib- 
class of errors. 

Classes of Transformations in Well-formed Sentences 

The detailed analysis of the prose samples included identification 
of every transformational operation in every sentence. Four data 
sheets were then prepared for each student (164 sheets); 1) Before 
well-formed sentences, 2) After well-formed sentences, 3) Before 
malformed sentences, and 4) After malformed sentences. Transfor- 
mations were entered appropriately on each sheet in the position 
opposite the number of the specific ti^.iisformation (1-46) and below 
the number representing the structural complexity score of the sen- 
tence in which the ti’ansformations occurred. Summaries were made 
according to the nine classes of transformations (Noun Expansion, 
Noun Replacement, Adjective Expansion, Verb Expansion, Adverbial 
Replacement, Adverbial Expansion, Conjoining, Deleting, and Simple) 
and proportions of classes of transformations were computed. Statistical 
evaluation of this information by analysis of variance indicated that 
there was a significant difference among the classes of transformations 
but that there was no significance between Before and After scores nor 
between the experimental and the control classes. In other words, it 
seems clear that the study of the grammar had no identifiable effect 
on the distribution of classes of transformations. Inspection of the data 
sheets suggests that further investigation of the frequency changes of 
individual transformations should be undertaken, though sudi an 
analysis of data is presently unfeasible. 

Summary 

The writing sample consisted of 70,823 Words, 1,731 sentences, 
and 8,533 transformations. Before and Alter average structural com- 
plexity scores for well-formed and malformed sentences. Before- and 
After-proportions of well-formed sentences. Before- and After-fre- 
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quendes of five classes of errors, and Before- and Aftei^proportions of 
nine classes dF transformations were evaluated by analysis of variance. 

The following condusions seem justifiable: 

1) Structural Complexity Scores of Well-formed Sentences 

Before and After Gains scores are significant at the .01 
level, and the interaction score is significant at the .05 level. 
However, statistical analysis fails to indicate a significant differ- 
ence between the control and the experimental dasses. 

No strong statistical claim can be made for attributing the 
greater gain of the experimental dass to the study of the 
grammar, though inspection of the data (Table 3) and the 
consistently greater gains scores of the experimental dass in 
the other comparisons is suggestive. 

2) Structural Complexity Scores of Malformed Sentences 

Since statistical analysis fails to indicate either a sig- 
nificant difference between the experimental and the con- 
trol classes or a significant interaction effect, change in average 
structural complexity scores of malformed sentences cannot 
be said to be dependent upon th^ study of the grammar. 

3) Proportion of WeU-formed Sentences 

Comparisons of Before and After scores, experimental 
and control classes, and interaction scores are all significant 
at th^ .01 level. The increase in production of well-formed 
sentences b^) the experimental class can imambiguously be at- 
tributed to the study of the grammar. 

4) Error Change Scores 

Comparisons of Before and After scores and the experi- 
mental and control classes are significant at the .01 level. 
However, the analysis fails to indicate a significant interaction 
effect. The clear relationship between increase in proportion 
of well-formed sentences and decrease in error production 
substantially supports the claim diat the greater change of the 
experimental class is attributable to its study of the grammar. 

5) Proportions of Classes of Transformations in WeU-formed Sen- 
tences 

When transformations were summarized by classes and 
changed to proportions, analysis of variance failed to indicate 
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a significant difference between Before and After scares and 
between experimental and control dasses. Tlie incondusiv&> 
ness of this analysis and inspection of the data sheets suggest 
that further investigation of frequency changes of individual 
transformations should be undertaken. 



3. CONCLUSIONS Am IMPLICATIONS 



It seems dear that daims must be joesented tentatively, re- 
gardless of the statistical level of significance, when the total popu- 
laticm was limited to forty-one pupils. Even, so, the persistently higher 
gains scores for the experimental dass in every comparison made 
strengthens the contrition that the study of a systematic grammar 
which is a theoretical modd of the process of sentnce production is 
the logical way to modify the process itself. 

It should also be observed that University School classes are 
most certainly atypical. Even though criteria of internal validity were 
adequately met tibrou^ careful randomization procedures, the 
sampling requirements needed to meet ariteria of external validity 
could not be adequately fulfilled. Consequently, it must be stated 
quite imequivocally that even though the net effect of the statistical 
analysis would strongly support the rejection of the null hypothesis 
that a knowledge of genrative grammar is unrelated to change in 
structural complexity scores, proportion of well-formed sentences, and 
error reduction scores, generalizations that reach beyond the scope of 
the sample are purely speculative. However, any failure to meet 
rig(m>us criteria of external validity should not lead one to dismiss the 
statistically significant results of an e?q>eriment in which criteria of 
internal validity were carefully attended to. The persistent tendency 
of researchers to conclude that a knowledge of grammar has no 
significant effect on language skills (when judgment should have been 
suspended) should certainly be reexamined. 

Since the esqperiment depended on a knowledge of generative 
grammar, the pupils in the experimental class had to be sufficiently 
intelligent to understand the subject matter of the two-year program. 
Randomization procedirres and statistical analysis presumably take into 
account the individual differences within and between classes; never- 
theless, some account of the relative intelligence of the two classes 
should be helpful in any final evaluation of the experimental results. 
Stanford-Binet Intelligence Quotient scores were available for all ex- 
perimental class pupils and all but two control class pupils. The aver- 
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age IQ of the control class was 115 with a range of 91 to 153; the 
average IQ of the experimental class was 118.2 wi*^h a range of 88 to 
153. Of grater interest, however, is the apparent lack of correlation 
between IQ and amount of increase in proportion of well-formed sen- 
tences as is shown in Table 16. 

One further comment regarding the manner in which the gener- 
ative grammar was taught seems important. The phrase structure 
component of the grammar was studied by the experimental class 
throughout the first year of the experiment, It was therefore not 
possible to present the transformational materials until the second 
year. Consequently, there was little time to explore the rhetorical 
applications of the grammar. Any great change in average complexity 
scores or in distribution of either classes of transformations or individual 
transformations would quite possibly have required more time. 



Table 16 



Intelligence and Before and After Proportions of Well-formed Sentences 



Cowtfel Clast 

lafor* Afhir Chang* IQ 



1. 


.639 


.811 


+.172 


(137) 


2. 


.786 


.720 


-.066 


(152) 


3. 


.455 


.588 


+.133 




4. 


.750 


.438 


-.312 




5. 


.517 


.633 


+.116 


(103) 


6. 


.677 


.564 


-.113 


(117) 


7. 


.645 


.553 


-.092 


(134) 


8. 


.717 


.605 


-.112 


(091) 


9. 


.568 


.867 


+.099 


(121) 


10. 


.674 


.692 


+.018 


(113) 


11. 


.412 


.596 


+.184 


(096) 


12. 


.488 


.614 


+.126 


(120) 


13. 


.438 


.620 


+.182 


(112) 


14. 


.625 


.808 


+.183 


(099) 


15. 


.581 


.483 


-.098 


(105) 


16. 


.613 


.436 


-.177 


(102) 


17. 


.469 


.605 


+.136 


(153) 


18. 


.581 


.614 


+.113 


(121) 


19. 


.809 


.707 


-.102 


(093) 


20. 


.452 


.765 


+.313 


(101) 



Exp«rim*ntal Claw 





••for* 


Aft*r 


Chang* 


IQ 


1. 


.569 


.946 


+.377 


(138) 


2. 


.419 


.828 


+.409 


(112) 


3. 


.500 


.692 


+.192 


(098) 


4. 


.671 


.945 


+.274 


(126) 


5. 


.426 


.804 


+.378 


(134) 


6. 


.490 


.838 


+.348 


(104) 


7. 


.345 


.960 


+.615 


(123) 


8. 


.610 


.977 


+.367 


(115) 


9. 


.604 


.962 


+.358 


(138) 


10. 


.357 


.897 


+.540 


(097) 


11. 


.776 


.939 


+.163 


(122) 


12. 


.692 


.710 


+.018 


(124) 


13. 


.704 


.922 


+.218 


(153) 


14. 


.300 


.725 


+.425 


(088) 


15. 


.541 


.750 


+.209 


(115) 


18. 


.830 


.978 


+.148 


(133) 


17. 


.561 


.985 


+.424 


(094) 


18. 


.933 


.961 


+.028 


(112) 


19. 


.303 


.913 


+.610 


(103) 


20. 


.575 


.933 


+.358 


(126) 


21. 


.529 


.750 


+.22 L 


(127) 
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CONCLUSION AND IMPUCATIONS 

Conclusions of tho Study 

1. school students can learn the principles of generative 
grammar relatively easily because of its consistency, specificity, and 
relevance to the notion of well-formedness. 

2. A knowledge of generative grammar enables students to in- 
crease significantly the proportion of well-formed sentences they 
write. 

3. Statistical analysis suggests, but does not prove, that there is a 
relation between a knowledge of generative grammar and an ability to 
produce well-formed sentences of greater structural complexity. Be- 
cause the experimental subjects increased the average complexity 
scores in well-formed sentences to a greater degree than did the 
control subjects, and because the control subjects increased the aver- 
age complexity scores in malformed sentences to a greater degree than 
did the experimental subjects, there is a strong inference that it was 
the knowledge of the generative grammar that enabled the experi- 
mental subjects to increase the complexity without sacrificing the 
granunaticality of tlieir sentences. 

4. When rigorous criteria of well-formedness are applied in the 
analysis of writing samples, results show that almost half of the sen- 
tences written by the ninth graders Wv^re malformed. This finding 
runs counter to the widespread contention of the structural linguist, 
who is not concerned with well-formedness as a grammatical goal, 
that children have acquired virtually full command of the grammar 
of English at an early age. The more likely contention is that the 
grammar of English is never fully mastered. 

5. A knowledge of generative grammar can enable students to 
reduce the occurrence of errors in their writing. 

Implications for Further Study 

1. The changes in the writing of the experimental class strongly 
support the hypotheses that 1) generative grammar is a logical repre- 
sentation of the psychological process of sentence formation, and 2) 
understanding this process enables the student to write more gram- 
matically. Further research in psycholinguistics and in the teaching 
of generative grammar may make it possible to identify not only a 
clearly defined set of psychological operations that have relevance 
to the composing process but also an analogous set of logical descrip- 
tions that would provide a significant structure for composition pro- 
grams. At the same time it might also be possible to identify sets of 
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grammatical misoperations that characterize the writing of children 
at different age levels. A scale of expected compositional behavior for 
diildren of different ages could be constructed by using a detailed 
analytical device of die sort described in this study. The explicit 
descdption of grammatical operations and misoperations could then 
provide a basis for developing padkages of compositional materials 
to be used at the different grade levels. 

2. The use of transformational theory in developing instructional 
units for the experimental class focuses concern on the well-formed- 
ness or grammaticality of written sentences. Those analyses which 
list or identify all grammatical structures without distinguishing well- 
formed from malformed sentences— models from structural linguistics, 
for example-do not really provide the composition teacher with useful 
characterizations of grammaticality. 

3. This analysis of prose made use of an instrument that identi- 
fied forty-six transformational operations for producing sentences. The 
more precise the analytical instrument, presumably the more precise 
the description of writing will be. The corollary suggests that those 
attempts to relate maturity of written expression to a single index- 
like sentence length, clause length, frequency of subordinate clauses— 
are not likely to produce valid estimates of writing maturity, let alone 
precise descriptions of the writing, 

4. GeneralizatiC'Us beyond this limited sample must be drought 
of as speculations. Nevertheless, it seems clear that this study provides 
a strong motivation for systematically investigating such speculations. 

More immediate answers are needed to such questions as tire 
following: ! 

a) Could this study be replicated in communities whidi 
differ culturally and economically? 

b) Could generative grammar be taught in the elementary 
grades? 

c) If a class had more time to make systematic applications 
of the generative grammar to rhetorical matters, would 
there be greater differences in Before and After Cains 
Scores? The development of more economical methods 
for presenting a generative grammar to students clearly . 
indicates that a pedagogically adequate generative gram- 
mar could be tau^t in much less than two academic 
years. 



SOME CONCLUSIONS OF THIS STUDY 



. . . A knowledge of generative grammar enables students to increase 
significantly the proportion of well-formed sentences they write. 

. . . A knowledge of generative grammar seems to enable students to 
increase the complexity without sacrificing the grammaticality of 
their sentences. 

. . . A knowledge of generative grammar can enable students to reduce 
the occurrences of errors in their writing. 

. . . Because generative grammar seems to be a iogical representation 
of the psychological process of sentence formation, understanding 
this process enables the student to write more grammatically. 
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